Will AI avoid exploitation? Artificial general intelligence and expected utility theory

Abstract A simple argument suggests that we can fruitfully model advanced AI systems using expected utility theory. According to this argument, an agent will need act as if maximising they’re avoid exploitation. Insofar should expect exploitation, it follows utility. I spell out more carefully and demonstrate fails, but show the manner of its failure is instructive: in exploring gain insight into how systems.